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MACRO FACILITIES FOR DIRECTION OF 
STREAMING DIGITAL CONTENT 

Inventors: William Kress Bodin 
Derral Charles Thorson 

BACKGROUND OF THE INVENTION 
Field of the Invention 

The field of the invention is data processing, or, more specifically, methods, systems, and 
products for macro facilities for direction of streaming video. 

Description of the Related Art 

Streaming digital content delivered to users via networks is a powerful way of delivery 
substantive content of entertainment, education, and business communications to users. In 
the current state of the art, however, the users themselves are required to control 
presentations of streaming digital content. Many prior art implementations of streaming 
video and audio, including for example, RealPlayer™ from RealNetworks, Inc., of Seattle, 
Washington, Apple's QuickTime™, and Microsoft's Windows Media Player, actually 
require user to have some kind of video viewer application open in order to control video 
streaming. User controls are simple, including the analogues for the controls found on 
VHS videotape recorders, Play, Pause, Stop, and the like. During playback of a clip in 
such prior art devices, no director control is provided on the server side of the stream of 
digital content. Most prior art systems for formulating presentation of streaming digital 
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content are oriented to formulating playback of clips recorded prior to their presentation 
over a network. To the extent that control systems exist for formulation and control of 
digitized output streams of live video and audio, such controls are expensive and 
specialized, typically requiring direct connection to particular servers, workstations, or 
other computers. There remains in the art therefore, a need for convenient, powerful, 
flexible, means of formulating and controlling streaming digital content. 
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SUMMARY 

Disclosed are methods, systems, and computer program products for macro control of 
streaming digital content, implemented in conjunction with a network of computers 
including a content server through which digital content is transcoded into streams of 
multimedia data, the streams communicated via network to client devices, the digital 
content selected for inclusion in streams in dependence upon remote director instructions, 
the remote director instructions comprising hyperlinked URLs invoked through a 
network-capable device, the remote director instructions further comprising for each URL 
in a remote director instruction a computer program that is executed when the URL is 
invoked. Typical embodiments include recording in non-volatile, machine-readable 
storage, the digital content. 

Typical embodiments also include storing in computer memory macros, each macro 
comprising a URL and a first time, the URL being a hyperlinked URL component of a 
remote director instruction, the first time being the time when the URL was first invoked 
through a hyperlink as part of a remote director instruction for control of streaming digital 
content, the macros being stored in the order in which the URLs are first invoked through 
hyperlinks. Typical embodiments also include reading from computer memory the macros 
in the order in which the macros were stored and invoking each URL of each macro as a 
hyperlink at a second time, the second time being dependent upon the first time, invoking 
each URL further comprising formulating and issuing a remote director instruction. 

Typical embodiments include retrieving from non- volatile, machine-readable storage, 
transcoding, selecting for inclusion in output streams, and communicating to client devices, 
in dependence upon remote director instructions, digital content. Typical embodiments 
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include recording approximately the original raw form of the digital content. Typical 
embodiments include executing upon a content server through a Java servlet within the 
content server computer programs identified by URLs, and in many embodiments, the 
computer programs comprise Java thread-level URL dispatch routines. 

In many embodiments, transcoding, selecting for inclusion in output streams, and 
communicating to client devices are all carried out in dependence upon user preferences, 
user demographics, and client device attributes. In typical embodiments, transcoding, 
selecting for inclusion in output streams, and communicating to client devices are all 
carried out in dependence upon current real time remote director instructions received from 
a director coupled to the content server through a servlet within the content server. 

Some embodiments include establishing a first start time for an event, the event comprising 
a multiplicity of sources of digital content, the event having a duration; recording in 
non-volatile, machine-readable storage, digital content; storing in computer memory, 
during the duration of the event, macros, each macro comprising a URL and a first elapsed 
time, the URL being a hyperlinked URL component of a remote director instruction, the 
first elapsed time being the elapsed time after the first start time when the URL was first 
invoked through a hyperlink as part of a remote director instruction for control of 
streaming digital content, the macros being stored in the order in which the URLs are first 
invoked through hyperlinks; establishing a second start time for retransmitting the event; 
reading from computer memory the macros in the order in which the macros were stored; 
invoking each URL of each macro as a hyperlink at a second elapsed time after the second 
start time, the second elapsed time being approximately equal to the first elapsed time of 
the macro, invoking each URL further comprising issuing a remote director instruction; 
and retrieving from the non- volatile, machine-readable storage, transcoding, selecting for 
inclusion in output streams, and communicating to client devices, in dependence upon 
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remote director instructions, the digital content; whereby is effected a retransmission of an 
event. 

Many embodiments include registering a user for a retransmission of an event, the 
retransmission of an event identified by an event identification code, the retransmission of 
an event comprising at least one video stream, at least one source, a start date and a start 
time; logging in the user for the retransmission of an event, logging in the user further 
comprising assigning values to user login attributes, the user login attributes comprising 
user identification, device type, network address, and a tier; and assigning a tier value in 
dependence upon the device type and the event identification code. In many such 
embodiments, the selections are dependent upon the tier. In many such embodiments 
transcoding includes transcoding in dependence upon the tier, and communicating to at 
least one of the client devices the output video stream includes communicating the output 
video stream to the network address. 

Many embodiments include registering a user which further includes creating an event 
registration record comprising event registration attributes comprising user identification, 
event identification, event subscription level, start date, and start time. Many such 
embodiments include assigning a tier value which further includes assigning a tier value in 
dependence upon the event subscription level. 
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BRIEF DESCRIPTION OF THE DRAWINGS 



Figure 1 is an overall block view of an embodiment of a system for remote direction of 

streaming digital content. 
Figure 2 is a process flow diagram illustrating several example embodiments of methods of 

remote direction of streaming digital content. 
Figure 2a is a data structure diagram of exemplary embodiments of attributes of tiers. 
Figure 2b is a data structure diagram of exemplary embodiments of attributes of client 

devices. 

Figure 2c is a data structure diagram of exemplary embodiments of attributes of 

commercial schedules. 
Figure 2d is a data structure diagram of exemplary embodiments of attributes of users. 
Figure 2e is a data structure diagram of exemplary embodiments of attributes of events. 
Figure 3 is an example embodiment illustrated as a use case. 
Figure 4a illustrates an example embodiment of an alternative servlet architecture. 
Figure 4b illustrates an example embodiment of an alternative servlet architecture. 
Figure 5 is a process flow diagram for an example embodiment of a macro facility. 
Figure 6 illustrates an example embodiment of an alternative servlet architecture including 

a coupled macro facility. 
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DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS 



Introduction 

The present invention is described primarily in terms of methods for remote directions of 
networked streaming digital content presentations. Persons skilled in the art, however, will 
recognize that any computer system that includes suitable programming means for 
operating in accordance with the disclosed methods also falls well within the scope of the 
present invention. 

Suitable programming means include any means for directing a computer system to 
execute the steps of the method of the invention, including for example, systems comprised 
of processing units and arithmetic-logic circuits coupled to computer memory, which 
systems have the capability of storing in computer memory, which computer memory 
includes electronic circuits configured to store data and program instructions, programmed 
steps of the method of the invention for execution by a processing unit. The invention also 
may be embodied in a computer program product, such as a diskette or other recording 
medium, for use with any suitable data processing system. 
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Embodiments of a computer program product may be implemented by use of any recording 
medium for machine-readable information, including magnetic media, optical media, or 
other suitable media. Persons skilled in the art will immediately recognize that any 
computer system having suitable programming means will be capable of executing the 
steps of the method of the invention as embodied in a program product. Persons skilled in 
the art will recognize immediately that, although most of the exemplary embodiments 
described in this specification are oriented to software installed and executing on computer 
hardware, nevertheless, alternative embodiments implemented as firmware or as hardware 
are well within the scope of the present invention. 



Definitions 



In this specification, the terms "field;' "data element ," and "attribute" are used as 
synonyms, referring to individual elements of digital date. Aggregates of data elements are 
referred to as "records" or "data structures." Definitions of complex data structures that 
include member methods, functions, or software routines in addition to data elements are 
referred to as "classes." Instances of complex data structures are referred to as "objects" or 
"class objects." 

"API" refers to an application program interface. APIs are standard sets of routines, 
protocols, and tools for building software applications. 

The terms "client," "client device," and "device" are used as synonyms in this 
specification, referring to any device capable of accessing a server through a network. 
Examples of client devices are personal computers, special purpose devices that are 
internet-enabled, internet-capable personal data organizers, and others that will occur to 
those of skill in the art. Various embodiments of client devices are capable of wired and/or 
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wireless network access. The use as a client device of any instrument capable of accessing 
a server through a network is well within the present invention. 

The term "network" is used in this specification to mean any networked coupling for data 
communications. Examples of networks useful with the invention include intranets, 
extranets, internets, local area networks, wide area networks, and other network 
arrangements as will occur to those of skill in the art. The use of any networked coupling 
from client devices to one or more content servers is well within the scope of the present 
invention. 

The term "servlets" refers to software modules that extend request/response-oriented 
servers, such as Java-enabled web servers. For example, a servlet might be responsible for 
taking data in an HTML order-entry form and applying the business logic used to update a 
company's order database. Servlets are to servers what applets are to browsers. Unlike 
applets, however, servlets have no graphical user interface. Servlets can be embedded in 
many different servers because typical servlet APIs assume nothing about a server's 
environment or protocol. As a practical matter, servlets are most widely used within HTTP 
servers, and many web servers support Java servlet technology. 

"CGI" refers to the standard Common Gateway Interface for implementation of server 
scripts. Servlets are an effective replacement for CGI scripts. Servlets provide a way to 
generate dynamic documents that is both easier to write and faster to run. Servlets also 
address the problem of doing server-side programming with platform-specific APIs: they 
are developed with a Java Servlet API, a standard Java extension. In this fashion, in typical 
embodiments of the present invention, servlets are used to handle HTTP requests issued 
through browsers from client devices. 
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In conjunction with multithreading technology, which is strongly supported in Java for 
example, servlets are very supportive of collaboration among people. A single servlet can 
handle multiple requests concurrently, and can synchronize requests. Servlets can forward 
requests to other servers and servlets, so that servlets can be used to balance load among 
several servers that mirror the same content, and to partition a single logical service over 
several servers, according to task type or organizational boundaries. 

"URL" means Universal Resource Locator, the standard method of associating world wide 
web data locations with network addresses for data communications. Many embodiments 
of the invention function by associating URLs with Java member methods in servlets on 
content servers, the member methods being called, run, invoked, or activated by invocation 
of associated URLs. In fact, some standard forms of URL are capable of directly 
identifying servlets, member methods within servlets, and providing data parameters for 
use in calls to member methods in servlets. Such URLs are typically invoked through areas 
of display screens in client devices, the display screen areas being activated for receipt of 
mouse clicks, gestures, shortcuts, keystrokes on keyboards, or other physical indications of 
URL selection or invocation. 

Servlet URLs can be used in HTML tags, where, for example, would otherwise be found 
URLs for CGI scripts or URLs identifying file locations on web sites. Servlet URLs are 
used, for example, as destinations of HTML anchors, as actions in HTML forms, and as 
locations to be used when HTML META tags direct that HTML pages be refreshed. 

"World Wide Web," or more simply "the web," refers to the well-known system of internet 
protocol ("IP") servers that support specially formatted documents, documents formatted in 
a language called HTML for HyperText Markup Language. The term "web" is used in this 
specification also to refer to any server or connected group or interconnected groups of 
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servers that implement the Hypertext Transport Protocol, "HTTP," in support of URLs 
and HTML documents, regardless whether such servers or groups of servers are coupled to 
the world wide web as such. 

HTML supports hyperlinking URLs connecting to other documents as well as graphics, 
audio, and video. Hyperlinks support changing documents by invoking URLs through "hot 
spots." In this specification, the term "hot spot" is used to refer to any area of a display, the 
area being associated with a particular URL, which area is sensitive to physical indications 
of invocation, including for example, mouse clicks on radio buttons and shortcut graffiti 
gestures on scratch pads of personal data organizers such as PalmPilots T M. 

Detailed Descriptions 

This specification discloses example embodiments of methods, systems, and products for 
controlling and delivering digital content to a number of clients. In typical embodiments, 
the clients need not control separate digital content feeds but rather will get a consistent 
feed based on the preemption and routing of the digital feeds from a content server. In 
typical embodiments, a director controls the content server, and most embodiments support 
as a director any device that can attain network access. More specifically, there is in 
typical embodiments no requirement that the director be a terminal directly coupled to the 
content server. 

Typical embodiments of the inventive methods and systems provide means for distributing 
any form of digital content from any digital media to any number of web clients while 
maintaining a control mechanism by a remote director. This control mechanism or director 
further supports changing digital content sources and streams, and changing attributes such 
as frame rates, so as to provide seamless presentations to any number of clients. Typical 



11 



AUS9200100619US1 



Patent Application 



embodiments of the director mechanism allow for a hands-off approach in terms of the 
client devices. Users in typical embodiments are not required to operate any controls on 
client devices but rather can simply view the contents of the streaming presentation. 

Referring to Figure 1, an aspect of the invention is seen as a macro facility (120) for remote 
direction of streaming digital content from a multiplicity of sources (106) of digital 
information to a multiplicity of client devices (102) implemented upon a network (108) of 
digital computers, at least one of the digital computers comprising a content server (100) 
upon which system is implemented in computer memory and at least one computer 
processor. The aspect of the invention depicted in Figure 1 includes embodiments of 
recording an original form of raw digital content (1 18) and later playing back (116) the 
recorded digital content under control of the macro facility (120). 

A more detailed example embodiment is shown in Figure 2 as including a method of 
remote direction of streaming digital content. The example of Figure 2 includes also 
receiving (221) digital content from sources (106), the digital content having many 
different digital formats. Examples of digital formats useful with various embodiments of 
the invention include JPEG, MP3, MPEG, GIF, HTML, text, XML, and the like. Other 
digital formats for digital content will occur to those of skill in the art, all of which formats 
are useful with embodiments of the present invention. 

A further embodiment shown in Figure 2 includes receiving (202), from a remote director 
(104), and storing in computer memory, remote director instructions (204), the remote 
director instructions including instructions for selections of digital content for inclusion in 
an output stream. The illustrated embodiment further includes transcoding (220) the digital 
content from sources into digital content having streaming format (223). 
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The illustrated embodiment also includes in at least one output stream (225), in 
dependence upon the remote director's instructions, digital content having streaming 
format. The illustrated embodiment, as do typical embodiments, includes communicating 
through a data communications network to at least one client device (102) the output 
stream (225). 

In typical embodiments, client devices comprise client device attributes, and transcoding 
includes transcoding in dependence upon the client device attributes. More specifically, 
for example, transcoding includes in typical embodiments transforming digital data content 
to conform to a device's screen size, color requirements, or audio availability. Client 
device attributes typically include, for example, device type, screen size, frame rate, and 
audio availability. 

In typical embodiments, transcoding includes transforming JPEG images into streaming 
format. In many embodiments, transcoding includes transforming a digitized digital 
content feed from a video camera into streaming format. In many embodiments, 
transcoding includes transforming a digitized video feed from a video camera into 
streaming format for a particular screen size or a particular frame rate. Transcodings 
including other data transformations as will occur to those of skill in the art. Any 
transformation of digital content is well within the scope of the present invention. 

In many embodiments, the remote director (104) comprises a personal computer coupled 
through a network to the content server (100), and the method in many embodiments 
includes sending from the remote director to the content server remote director instructions 
(204). In many embodiments, sending director instructions includes invoking through 
URLs displayed on a terminal of the remote director member methods of servlets installed 
on the content server, each URL invoking a single servlet member method, each servlet 
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programmed to administer threads of execution to carry out remote director instructions. 
In many embodiments servlets comprise member methods in Java objects, and invoking a 
servlet, or invoking a servlet member method, means to call a public member method in a 
Java object. In many embodiments, the member methods are implemented as Java 
thread-level URL dispatch routines. Remote director instructions typically comprise at 
least one instruction to select for transcoding and streaming digital content from a specific 
source. 

More specifically, for example, servlet URLs are typically implemented in the following 
form: 

browser url = "http://myIP:8080/servlet/myservlet?parml=parameterl 
browser url = "http://myIP/myservlet?parml=l&parm2=2 

The following is a typical example of an embodiment of servlet structure represented in 
pseudocode: 

import javax. servlet.*; 
import javax.servlet.http.*; 

public class myservlet extends HttpServlet 

{ 

public void init(ServletConfig conf) throws ServletException 
{ 

super.init(conf); 

} 
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public void service(HttpServletRequest req, HttpServletResponse res) throws 
IOException { } 

public void destroyO { } 

} 

The following is a typical example of a computer program, in this particular example, a 
Java member method implemented as a Java thread-level URL dispatch routine and 
depicted in the following pseudocode: 

public void service(HttpServletRequest req, HttpServletResponse res) throws 
IOException 

{ 

request = req.getParameter( M request"); 
if(request.equalsIgnoreCase("view")) 

getView(); 
if(request.equalsIgnoreCase("reset")) 

reset(); 

} 

Figures 4a and 4b illustrated embodiments of alternative servlet architectures. The 
example embodiment shown in Figure 4a includes a director (104) coupled for data 
communications to a first servlet wherein the first servlet administers threads of execution 
for remote director instructions (408). The example architecture of Figure 4a includes also 
a second servlet (410), the second servlet being configured to administer threads of 
execution which themselves carry out data communications with individual client devices. 
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In typical embodiments, each thread of execution for a client device (406) is assigned to a 
particular client device located on a network by an internet protocol address known to the 
thread. In the example architecture of Figure 4a, the first servlet is coupled to the second 
servlet for communication of data and for communication of instructions by calls to 
member methods within the second servlet. In the example architecture of Figure 4a, the 
coupling between the two servlets is accomplished through threads of execution 
administered by the first servlet. In embodiments of this kind it is typical that each thread 
would be assigned responsibility for carrying out one remote director instruction regarding 
control of the streams of digital content communicated to client devices by use of the client 
communications threads of the second servlet. Further alternative embodiments of 
inter-servlet communications and control will occur to those of skill in the art, all such 
embodiments being well within the scope of the present invention. 

Figure 4b illustrates an alternative example embodiment of servlet architecture useful with 
the present invention. In the example embodiment of Figure 4b, both the threads for client 
communications (406) and the threads for execution of remote director instructions (408) 
are implemented through a single servlet (412). Alternative example architectures include 
implementation of an additional servlet administering threads of execution for data 
conversion and transcoding, or an additional servlet administering threads of execution for 
selecting particular sources of digital content for particular output streams. Further 
alternative embodiments of servlet architecture will occur to those of skill in the art, all 
such embodiments being well within the scope of the present invention. 

It is useful to note that in typical embodiments, there is no required physical difference 
between the director and the client devices. Both are often personal computers coupled for 
data communications through a network to a content server. What distinguishes the 
director in typical embodiments is that the director in logging on to the server is accorded 
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access through URLs to member methods to which access is restricted to users not having 
director privileges. In many embodiments, only one director is allowed access at any 
particular time, to reduce the risk of conflicting director instructions, although there is no 
particular exclusion within the invention itself of allowing more than one director coupled 
to a content server. 

Many embodiments of the present invention include registering a user for a service, the 
service being identified by a service identification code. Figure 2 at reference 208 shows 
an example embodiment of a data structure representing a user's registration for a service, 
including a user identification code (226), a service identification code (234), and a service 
subscriber level (236). The service subscriber level is included in the illustration because 
many embodiments associate fee structures and levels of service with service subscription 
levels. Services typically comprise aggregations of digital content streamed through one or 
more websites to users through client devices over an extended period of time. Indeed, in 
typical embodiments, the services themselves are not time-limited, although the user's 
service registrations often are (237). User's service registrations are often time-limited 
because fee structures impose time limits on the service registrations as such, although 
such time limits to not affect the services themselves. 

Typical embodiments include logging in a user for the access to a service. Logging in a 
user typically includes assigning values to user login attributes (206), including for 
example, user identification (226), device type (228), network address (230), and a tier 
(232). The user identification typically is determined through a login prompt. The device 
type in typical embodiments is derived from a browser header at logon. The network 
address in many embodiments is an internet protocol address, in many embodiments used 
to comprise a socket. 
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The tier is an identifier for a group of client devices identified according to grouping 
factors such as, for example, device type, subscription level, user demographics or user 
preferences. Tiers in typical embodiments are identified in tier attribute data structures 
such as the one illustrated for example at reference 218 in Figure 2. A more detailed 
example embodiment of a data structure representing a tier is illustrated at Figure 2a, 
where an example tier is shown as including a tier identification code (232), a device type 
(228), a data element for user demographics (242), a data indication of user preferences 
(244), a commercial schedule identification code (246), a service identification code (234), 
a service subscriber level (236), an event identification code (238), and an event 
subscription level (240). 

Demographics include such user attributes as age, residence location, income level, 
occupation, and other demographics as may occur to those of skill in the art. Embodiments 
using any demographic are well within the scope of the present invention. User 
preferences include attribute indicators of special needs in support of disabilities, content 
limitations such as exclusions of adult material, profane language, or depictions of 
violence, preferences regarding subjects of commercial messages, and other user 
preferences as occur to those of skill in the art. Embodiments using any attribute indicators 
of any user preference regarding digital content are well within the scope of the present 
invention. 

Typical embodiments also include assigning a tier value in dependence upon the device 
type and the service identification code. In typical embodiments, director selection of 
digital content and transcoding are also dependent upon tiers. In typical embodiments, 
registering a user includes creating a service registration record (208) comprising service 
registration attributes comprising user identification (226), service identification (234), 
service subscription level (236), and service expiration date (237), and in such 
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embodiments, assigning a tier value typically include assigning a tier value in dependence 
upon the service subscription level. 

The director in such embodiments has the capability of formulating output streams 
according to tier. Thus an embodiment utilizing the example structure shown in Figure 2a, 
has the capability of presenting digital content in one or more output streams comprising a 
particular tier, for example, for a hand-held, network-capable, personal data organizer 
having a screen size of 800 x 600 pixels (according to device type 228), with content 
filtered to exclude graphic violence (according to user preference 244), with commercial 
content filtered to include automobile advertisements (user preference), with commercial 
content further filtered to exclude automobile advertisements for automobiles costing less 
than $30,000 (demographics 242), with commercials scheduled so as to occur no more than 
once per half-hour (in dependence upon service subscription level 236). Typical director 
access to servlets on the content server means that director instructions issued at any time 
by invoking URLs with as little as a single mouse click, one digitizing pad gesture, or a 
single keystroke, seamlessly and immediately alter tier structure and therefore the 
presentation of digital content to users of client devices in a tier. 
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Typical embodiments also include communicating to at least one of the client devices an 
output stream (225). In such embodiments, communicating the output stream or streams 
further comprises communicating the output stream to the network address (230) 
associated with a user's login (206 on Figure 2). It is useful to note that in many 
embodiments, the network address associated with a user's login is a network address, 
typically associated with a URL, through which digital content is provided for a tier, as at 
the example at reference (241) in Figure 2a. That is, in such embodiments, as shown in 
Figure 2, the tier assignment function (224) assigns to the user login (206) a tier (232) 
according to client device type (214), user attributes (212), commercial schedules (216), 
and service registrations (208) or event registrations (210). 

Many embodiments that assign network addresses to tiers, as shown for example at 
reference 241 in Figure 2a, do not use network addresses in user logins, because in such 
embodiments, the stream output to the user and the user's client device will be directed 
through the network address identified with the tier. Some embodiments do not use tiers; 
such embodiments typically therefore assign a network address to individual user logins. 
In many embodiments, the assigned network address, whether it is assigned directly 
through a user login or indirectly through a tier structure, identifies a URL to which the 
client device browser is directed at login, the URL identifying a website location through 
which an output stream for the tier is delivered to client devices associated with user logins 
having the same assigned tier. 

Turning again to Figure 2, an additional example embodiment is shown as including 
registering a user for an event (210). Event registrations (210) typically include attributes 
for user identification (226), event identification (238), and event subscription level (240). 
Events are aggregations of digital content presented through networks to client devices, the 
events having a start date (264) and a start time (266), that is, a defined approximate 
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beginning time, events typically being identified as shown in the example of Figure 2e, by 
an event identification code (238). Events typically aggregate at least at least one output 
stream and at least one source. 

The invention itself does not necessarily require event codes as such, although most 
embodiments do employ some means, such as event codes, of associating the aggregate of 
sources comprising an event. Alternative ways of identifying an aggregate of sources 
includes, for example, listing the sources in a list and using a single server for an event in 
which all sources available to the server are considered sources for an event. Events in 
typical embodiments are distinguished from services by possession of a starting time and 
typically also a defined duration, or an approximate duration, whereas services typically are 
ongoing for undetermined durations. 

Embodiments comprising events typically include logging in users for the event, logging in 
users typically -including assigning values to user login attributes (206), the user login 
attributes typically including user identification (226), device type (228), network address 
(230), and a tier identification (232). 

In embodiments including events, tier values typically are assigned in dependence upon 
event identification codes (240). Many embodiments that include events also assign tiers 
in dependence upon event subscription levels (240). Of course many such embodiments 
also assign tiers in dependence upon device types, demographics, or user preferences. 

Turning now to Figure 3, an embodiment of the method of the present invention is 
illustrated as a use case for an event comprising a football game. In the illustrated 
embodiment of Figure 3, a user (103) through a client device (102) registers (406) for an 
event. The use in the illustrated case has no previous service registration, is therefore 
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unknown to the content server, and user attributes (212), including preferences and 
demographics, are therefore gathered at registration. Registering for this previously 
unknown user includes assigning to the use a user identification code. 

After registering for the event, either prior to or after the event begins, the user logs in 
(408) to view the event. At login, the user login record (206) is created and assigned (224) 
a device type and a tier. The device type is either taken from a default device type stored in 
user attributes at the time of registration, or is taken from a browser header at the time of 
login. The tier is assigned by matching user attributes with tier attributes among more than 
one tier record and selecting a tier whose demographics, user preferences, and device type 
match or approximately match the user's demographics, user preferences, and/or device 
type. 

Now in the illustrated embodiment of Figure 3, transcoding (220) and digital content 
selection (410) for an output stream for the tier are all accomplished in dependence upon 
the tier value so assigned. If, for example, the tier assigned on the basis of device type and 
user attributes has attributes including a device being a high definition video screen, no 
preferences as to language, violence, or adult content, and demographics of high income 
bracket, an output stream having digital content meeting these requirements is formulated 
by transcoding and selecting digital content in response to director instructions. The output 
stream (225) so formulated is communicated (224) in the illustrated embodiment to the 
user (103) through the client device (102) from the network address (414) associated by the 
tier (218) with the output stream (225). 

If after registration no tier exists that is a good match for the user attributes, a new tier is 
created having attributes that well match user attributes. Creating a new tier merely 
includes typing in through a keyboard, for example, into a new tier record, a new set of tier 
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attributes including a network address or URL through which an output stream formulated 
in accordance with the new tier attributes is communicated to client devices. In typical 
embodiments the quality of match between tier attributes and user attributes is determined 
according to tier selection criteria. Many formulations of tier selection criteria will occur 
to those of skill in the art. Any tier matching criteria used with any embodiment of the 
invention are well within the scope of the invention. 

In the illustrated embodiment of Figure 3, the software functions (404) associated with a 
director are stored in a content server (100). Coupled through a network for data 
communication to the content server in the illustrated embodiment are several personal 
computers comprising director workstations (402). In typical embodiments of this kind, at 
least one of the director workstations (416) is configured to present output streams 
formulated for tiers in dependence upon director's instructions. In such embodiments, at 
least one of the director workstations (412) is configured to present for invocation through 
a user interface URLs that in turn invoke director functions or member methods 
comprising director functions such as servlets that when invoked or called issue or 
comprise director instructions for transcoding and selecting digital content to formulate of 
an output stream. 

In typical embodiments that include events, selections effected by director instructions are 
dependent upon the tier, and transcoding includes transcoding in dependence upon the tier. 
Director instructions for selection of digital content and transcoding in dependence upon 
tier result in output streams formulated and presented according to tier, and in such 
embodiments, communicating to client devices the output stream includes communicating 
the output stream to a network address associated with a user login. As described above, 
typical embodiments utilizing events assign the network address for communication of 
output streams through the tier (reference 241 on Figure 2a). 
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Turning now to Figure 5, a further aspect of the invention is seen illustrated in an example 
embodiment of a macro facility implemented in the illustrated example as a method of 
macro control of streaming digital content. The example embodiment of Figure 5 includes 
implementing the example method upon a networked system of computers including a 
content server (100) through which digital content is transcoded into streams of multimedia 
data, the streams (502) communicated via network to client devices (102), the digital 
content selected for inclusion in streams in dependence upon remote director instructions 
as described in more detail above, the remote director instructions comprising hyperlinked 
URLs invoked through a network-capable device, the remote director instructions further 
comprising for each URL in a remote director instruction a computer program that is 
executed when the URL is invoked. 

The illustrated example method includes recording (504) in non- volatile, machine-readable 
storage (506), the digital content in approximately its original form. The illustrated 
example method includes storing (514) in computer memory macros (516), each macro 
comprising a URL (518) and a first time (520), the URL being a hyperlinking URL 
component of a remote director instruction (204), the first time being the time when the 
URL was first invoked through a hyperlink as part of a remote director instruction for 
control of streaming digital content. In typical embodiments, the macros are stored in the 
order in which the URLs are first invoked through hyperlinks. 

Typical embodiments of the kind illustrated include reading from computer memory the 
macros in the order in which the macros were stored, invoking each URL of each macro as 
a hyperlink at a second time, the second time being dependent upon the first time. 
Invoking each URL of each macro in sequence in dependence upon the first time results in 
a playback of the original digital content, selected, transcoded, and streamed to client 
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devices in a fashion substantially similar to the original transmission of the digital content 
to client devices. 

The dependency upon the first time is useful in organizing the playback because the 
interval between remote director instructions is maintained at approximately the same 
interval as existed during the original transmission. In some embodiments, the dependence 
upon the first time is calculated by reference to an arbitrarily selected start time for the 
playback, and some embodiments employ a system clock reset to simulate the original 
times stored in the macros. Alternative methods of establishing proper time dependency 
will occur to those of skill in the art. Any reasonable means or method of establishing a 
dependency of a playback time on the original recorded time is well within the scope of the 
invention. 

Invoking each URL in typical embodiments includes formulating each URL into a remote 
director instruction and issuing (522) the instruction to a content server. Typical 
embodiments include retrieving from the non-volatile, machine-readable storage, 
transcoding, selecting for inclusion in output streams, and communicating to client devices, 
in dependence upon remote director instructions formulated from the stored macros, the 
recorded original digital content. 

Figure 6 illustrates a useful aspect of typical embodiments. In the example embodiment of 
Figure 6, a macro facility (120) is coupled for data communications to a content server 
(100) through a servlet (100). The architecture of the example in Figure 6 is similar to that 
of Figure 4b, using a single servlet to administer both threads for executing director 
instructions (408) and threads for streaming content to particular client devices (406). In 
the illustrated example a director (104) is also coupled through the servlet to the content 
server. It is useful to note that from the point of view of the server and the servlet, there is 
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no requirement within the present invention for it to make any difference whether a 
particular remote director instruction is received directly from the director in real time or 
received from the macro facility as part of a playback of a series of previously recorded 
macros. 

One of the benefits of this architecture is that the director has real time control of the 
playback exactly as if the recorded digital content were being transmitted for the first time. 
The director in typical embodiments is empowered to allow the recorded macros to play 
back with little or no real time intervention. The director in such embodiments is capable 
of issuing remote director instructions in real time, however, so as to correct for conditions 
currently affecting the retransmission of digital content, such as, for example, sequences of 
commercial content that differs from the commercial content that was transmitted as part of 
the original transmission of the recorded digital content. 

It is useful for playback to record the original digital content in approximately its raw form, 
prior to data transcoding or formatting for digital streaming. In embodiments in which the 
digital content is available from recordings or computer storage in approximately its raw 
form, then the retrieval from storage of the digital content is available for treatment by 
transcoding, selection and streaming just as was the original. On this basis, the 
retransmission, including transcoding, selection, and streaming is carried out in 
dependence upon user preferences, user demographics, and client device attributes, in a 
fashion substantially identical to the original despite the fact that the user demographics, 
user preferences, and client device attributes are very different from what they were at the 
time of the original transmission. In this sense, the idea that a retransmission is carried out 
in a fashion substantially identical to the original does not require that the retransmission in 
fact have identical form and content to the original. 
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The detail described here is that the retransmission retains its original capability of being 
configured in dependency upon user preferences, demographics, and client device 
attributes. For understanding, contrast this quality of many embodiments with 
embodiments that record only the output streams for playback. When only the output 
streams are available for playback, the user preferences, demographics and device 
attributes that affected the formulation of the output streams are fixed, with no capability of 
changing them and thereby affecting the formulation of output streams at the time of 
retransmission. Moreover, when only the output streams are available for recorded 
playback, the usefulness of real time director control at the time of playback is reduced 
because the director no longer has the same capability of affecting the formulation of the 
prerecorded output streams. In embodiments that include recording the raw original digital 
content, at the time of retransmission, no formulated output streams exist; instead, the 
output streams are formulated in real time, in the same fashion as was used to conduct the 
original transmission. 

Turning again to Figure 5, a more detailed example embodiment is shown as including 
establishing a first start time (508) for an event (248), the event comprising a multiplicity 
of sources of digital content (106). In typical embodiments, the event has a duration, a 
beginning time, and an ending time. 

The illustrated example embodiment includes recording in non- volatile, machine-readable 
storage, the original digital content of an event, and storing in computer memory, during 
the duration of an event, macros, each macro comprising a URL and a first elapsed time, 
the URL being a hyperlinking URL component of a remote director instruction. In typical 
embodiments, the first elapsed time is the elapsed time after the first start time when the 
URL was first invoked through a hyperlink as part of a remote director instruction for 
control of streaming digital content. In typical embodiments, the macros are stored in the 
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order in which the URLs are first invoked through hyperlinks. 

Typical embodiments include establishing a second start time (510) for retransmitting the 
event and reading from computer memory the macros in the order in which the macros 
were stored. Typical embodiments include invoking each URL of each macro as a 
hyperlink at a second elapsed time after the second start time, the second elapsed time 
being approximately equal to the first elapsed time of the macro. In typical embodiments, 
invoking each URL includes issuing a remote director instruction (522). Typical 
embodiments include retrieving from the non-volatile, machine-readable storage, 
transcoding, selecting for inclusion in output streams, and communicating to client devices, 
in dependence upon remote director instructions, the original recorded digital content. 

Embodiments of the kind illustrated often include registering a user for a retransmission of 
an event. In many embodiments, the retransmission of an event is identified by an event 
identification code. In many embodiments, the retransmission of an event includes at least 
one output stream, at least one source, a start date and a start time. In typical embodiments, 
logging in the user for the retransmission of an event includes assigning values to user 
login attributes. In typical embodiments, user login attributes include user identification, 
device type, network address, and a tier. Many embodiments include assigning a tier value 
in dependence upon device attributes. Many embodiments include assigning tier values in 
dependence upon and event identification codes. 

In many embodiments, selecting digital content for inclusion in output streams is 
accomplished in dependence upon a tier. In many embodiments, transcoding is carried out 
in dependence upon a tier. In many embodiments, communicating to client devices output 
video streams includes communicating an output video stream to a network address. In 
many embodiments, network addresses are internet protocol addresses. 
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In many embodiments that include registering users for events, registering a user includes 
creating an event registration record comprising event registration attributes such as user 
identification, event identification code, event subscription level, start date, and start time. 
Registering users in such embodiments typically includes assigning a tier value, and tiers 
are typically assigned in dependence upon an event subscription level. 

It will be understood from the foregoing description that various modifications and changes 
may be made in embodiments of the present invention without departing from its true 
spirit. All exemplary embodiments described in this specification are mere examples, not 
limiting definitions of the invention. It is intended that descriptions in this specification are 
only for purposes of illustration and are not to be construed in a limiting sense. The scope 
of this invention should be limited only by the language of the following claims. 
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